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Abstract 

Memory effects require for tlieir incorporation into random-walk models an extension of the 
conventional equations. The linear Fokker-Planck equation for the probability density p(r, t) is 
generalized to include non-linear and non-local spatial-temporal memory effects. The realization 
of the memory kernels are restricted due the conservation of the basic quantity p. A general 
criteria is given for the existence of stationary solutions. In case the memory kernel depends on 
p polynomially the transport is prevented. Owing to the delay effects a finite amount of particles 
remains localized and the further transport is terminated. For diffusion with non-linear memory 
effects we find an exact solution in the long-time limit. Although the mean square displacement 
shows diffusive behavior, higher order cumulants exhibits differences to diffusion and they depend 
on the memory strength. 
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I. INTRODUCTION 



Although the crucial factors governing the dynamics of systems, comprising many units, 
consist of interaction and competition, there is an increasing interest to include memory 
effects as a further unifying feature of complex physical IJas well as biological systems 
[sj. Recently ^ \ memory effects in correlated anisotropic diffusion are studied in nanoporous 
crystalline solids. Likewise the effects of transport memory are discussed in Fisher's equation 
[^, also applicable for bacterial population dynamics , resulting in non-linear damping and 
traveling wave solutions The transport with memory, depending on the survivability of 
a population, is analyzed in IsJ . In the present paper we emphasize in an analytical solvable 
model, that the generic behavior of the system may be changed when additional non-linear 
delay effects are included into the consideration. In particular, we discuss the transport 
behavior which is realized after a sufficient accumulation time and after cumulating particles 
within a spatial region. Thus the transport processes are affected by additional spatial 
correlations. The simplest way to describe transport in a medium is based on a random 
walk. The probability p{f, t) to find a particle at the position r at time time t is governed 
by the Fokker-Planck equation joj 

dtp{f, t)= M (r, t] p, Vp) . (1) 

Here the operator }A consists of an diffusive and a driving part. In case the diffusive part is 
relevant we follow scaling arguments, extended also to more general processes in . Based 
on that one can identify a diffusive time scale given by tb ^ l"^ / D. Here / is a typical length 
scale, where the probability is changed significantly. In case the transport process is realized 
after a spatial-temporal accumulation processes the time evolution of the probability could 
also depend on the history of the sample to which it belongs, i.e. the changing rate of the 
probability should be influenced by the changing rate in the past. Thus the evolution of 
the probability p(r, t) has to be supplemented by memory terms. Such a term models, for 
example the way on which a seed probability at a certain time t' had been accumulated by 
a delayed transport mechanism, originated by the surrounded environment of the particle. 
In general, the changing rate of p at time t is also determined by the accumulation rate 
at a former time t' < t. In between, i.e. within the interval t = t — t', the particles are 
enriched while changing the probability at t'. Regardless that process the available amount 
of particles at time t is governed by an instantaneous transport term as well as by the 



changing rate at former times t' . Consequently the evolution Eq. (^J) should be modified 
according to 

t oo 

dtp{f,t) = M{f,t;p,Vp) + j dt' j d'^r'IC{f-r,t-t';p,Vp)C{f^,t';p,Vp) (2) 

-oo 

This equation is of convolution type. Whereas the operator Ai characterizes the instanta- 
neous and local processes, both operators K. and £ are responsible for the delayed processes. 
In general the operators Ai,}C and C are assumed to be non-linear in p{r,t) and Vp{f,t). 
They have to be specified according to the physical situation in mind. In particular we show 
that the operators are restricted when p{f, t) is a conserved quantity. 

It is well-known that evolution equations with such a kind of memory kernels can be derived 
following the well established projector formalism due to Inl, see also Q- Notice that 
Eq. (j21) is an effective single particle equation embedded in a A^-particle system. The main 
approach for the further analysis consists of assuming that the time scale of the memory 
effects is controlled by the time scale of the probability itself. The environment of a single 
particle is determined by the transport processes of the remaining particle which follows 
approximately the same underlying physical processes. In the next section the operators /C 
and C are specified based on that argument. 

Our model can be grouped into the increasing efforts to discuss delay and feedback mech- 



anism. The analysis of the projector formalism 







had been successfully applied for the 



density-density correlation function studying the freezing processes in under-cooled liquids 
[isl Recently a Fokker-Planck equation with a non-linear memory term was used to 



discuss anomalous diffusion in disordered systems 11511. The results cou 
„„.e*al ..uM,o,. ,„c.„d.g diff„.o„ on see a.o Q Q 



d be confirmed by 
Moreover, it was 



argued [l^ that mobile particles remain localized due to the feedback-coupling. Notice that 
a formal solution of whole class of non-Markovian Fokker-Planck equations can be expressed 
through the solution of the Markovian equation with the same Fokker-Planck operator [2^ . 
The non-Gaussian fiuctuations of the asset price can be also traced back to memory effects 



21[. An additional cumulative feedback coupling within the Lotka-Volterra model, which 
may stem from mutations of the species or a climate changing, leads to a significant different 
behavior [2^ compared to the conventional model. If the Ginzburg-Landau model for the 
time evolution of an order parameter is supplemented by a competing memory term, the 
asymptotic behavior and the phase diagram is completely dominated by such a term [2^. 



Whereas the feature of the approach, proposed in those papers, consists of self-organization, 



i.e. the time scale of the memory is determined by the relevant variable itself. 



or mstance 
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the concentration, there is a broad class of models with external delay effects 
for a survey and applications in biology see j27|. That case is characterized by a given ex- 
ternal memory kernel. The differences of both approaches will be discussed also in j28[. The 
spreading of an agent in a medium with long-time memory, which can model epidemics, is 
studied in [2^. Time-delayed feedback control is an efficient method for stabilizing unstable 
periodic orbits of chaotic systems Isi^ where the time delay may induce various patterns 
including traveling rolls, spirals and other patterns j^. The influence of a global feedback 
is studied recently in a bistable system 3^ , where the purpose of that paper is a discussion 
of the domain-size control by a feedback. 

In view of the large variety of systems with feedback couplings it seems to be worth to study 
simple models, which still conserve the crucial dynamical features of evolution models such 
as inherent non-linearities and moreover, as a new ingredient, delayed feedback-couplings. 
In the present paper we discuss the influence of a non-Markovian memory term on trans- 
port processes. The retardation effects are characterized by the memory kernel /C, which is 
chosen in such a manner, that it competes with the conventional diffusion part and obeys 
the same symmetry properties. In particular, we discuss the transport behavior under the 
inclusion of non-linear memory term. Under that conditions the characteristic time is 
modifled. Accordingly we demonstrate, the long-time behavior is dominated apparently by 
the delay effects. The system is able to reach a stationary state with a flnite probability. 



II. MODEL 

In this section we specify the model, deflned by Eq. 0, under the assumption that basic 
quantity p{r, t) is conserved. This condition is realized by 

n^) = ^ / rfV(r,t)=0 . (3) 



00 



To preserve p the instantaneous term Ai has to be related to a current, e.g. A4 oc V ■ j. 
Choosing natural boundary conditions p = at the boundary), we get after a Laplace 
t r ansf ormation 

zP{z) - Po = k{z)L{z) with k{z) = f (frK{f,z), L{z) = [ d\ C{f, z) , (4) 



with Pq = P{t = 0). For an arbitrary polynomial kernel K the conservation law is in general 
not fulfilled provided the operator C is simply defined by £ = —dtp{r, t) (the minus sign is 
only for convention). Making this ansatz we conclude from Eq. (j^ 

[zP{z)-Po][K{z) + l] = 

and consequently the conservation law is guaranteed. Physically, the assumption for £ 
means, that we take into account a coupling of the rates, e.g. the evolution at the observation 
time t is directly coupled to the changing rate at t' < t. Processes in the past will be 
permanently reevaluated at present time. In doing so the memory kernel gives rise to a 
coupling of the time scales. In the vicinity of the upper limit t' ~ t the memory term reads 
/C[r, 0, p{f,0)]dtp{'r,t), i.e. a momentary change at the observation time t is coupled to the 
value at the initial time t = 0. Therefore the very past is related to the instantaneous 
value of p{r,t). In the opposite case, at the lower limit t' ~ 0, the change of the quantity 
p{f, t) near to the initial value dt' p{r, t' = 0) is directly coupled to the instantaneous value 
p{f, t) via the kernel. In such a manner the memory part represents a weighted coupling 
of the behavior at the initial time and the observation time. Due to the coupling of the 
rates the long-time behavior of the system will be modified. One reason for that could be 
that the reacting species are embedded into an environment of all the other particles of the 
system. Due to the mutual interaction, reactants, lacking at time t, were annihilated at 
an earlier time t'. Especially in sufficiently complex diffusion- reaction systems the feedback 
and memory effects should be relevant. In such system additional degrees of freedom like in 
flexible macromolecules in melts or in concentrated solutions |33|| , nematic elastomer 3^ or 
in biology js^]. In that context one is interested in the description of effluent reprocessing 
plants in systems with closed water circulation. A special ecosystem of aerobic and anaerobic 
microorganisms is evolved in the clariflers of such systems due to natural immigration or due 
to additional allowance. The living conditions of the microorganisms are mutually associated 
via the exchange of intermediate catabolic products. Each change of the concentration of 
one species will be stored in the food chain and effects the evolution of this species at a 
later time. Furthermore, the partial mixing in the clariflers by convection and diffusion 
processes enlarges the effects over the whole system, so that the memory integral introduced 
in Eq. includes both the time and the spatial coordinates. This special example may be 
extended also to other complex biological, chemical or engineering problems with various 



hidden degrees of freedom, which are able to influence the evolution of a selected component 
significantly, for instance by biological interaction with other species via the food chain or 
via biological competition. Such effects which are partially observable, could contribute to 
the memory term. 

From Eq. Q we can make some general statements for an arbitrary kernel /C(r, t; p, Vp) and 
£(r, t; p, Vp) = —dtpif, t). As stressed before the last condition guarantees the conservation 
of p{f,t). After Fourier transformation with respect to the spatial coordinate and Laplace 
transformation with respect to the time, we get from Eq. Q 

p{k,z) = ^ with D{k,z) = (5) 

z + D{k,z)k^ l + }C{k,z) 

— * 

where /C(fc, z) is the Fourier-Laplace transformed kernel. Assuming a regular behavior of 
the kernel we make the ansatz 

B(k) 

)C{k,z) = + n{k,z) with limr](A;,z) = finite . (6) 

Z z^O 

Provided the kernel reveals a finite stationary value lim }C{k,t) = B{k), then p{f,t) yields 

t— >oo 

a stationary solution, too. Inserting Eq. (jH)) in Eq. we obtain 

p(lz) = ^ + ij{k,z) 

with ,ik)-^^^ and p.ik)DP[l + m^)] . 

B{k) + Dk^ [A{k) + Dk^)][z{l + n{k,z)) + B{k) + Dk^] 

(7) 

Summarizing the results we conclude that the model, following Eq. (j21) for the conserved 
quantity p{f,t), gives rise to a non-trivial stationary solution g{k), or equivalent g{r), if the 
Laplace transformed kernel /C(/c, z) satisfies the conditions 

limz}C{k,z) ^0. (8) 

z—fO 



3- 



This result is a generalization of a previous one obtained for a homogeneous system 
Since p{f, t) is a probability density we can derive an evolution equation for the mean square 
displacement s{t) =< r*^ >. Provided the function p{f,t) is already normalized, one finds 

t t 
j^sit) = 2dD- J dt'kit - t')L2{t') - j dt'k^it - t')L{t') , (9) 





where K and L are defined in Eq. and K2 and L2 are the corresponding second moments. 
In the simplest case without memory and M. = D'V'^p{f, t) one concludes from Eq. ^ 
s{t) = 2dDt. In the next section we discuss two cases with non-zero kernel /C depending 
on p{f, t) itself, e.g. the time-space scale of the memory is given by the scales where the 
variable p{f,t) becomes relevant. 

III. NON-LINEAR MEMORY 

For applications we consider the case of diffusive instantaneous term given by 

M = DV'^p{f,t) , (10) 

where D is the diffusion constant. In the first subsection let us illustrate the infiuence of 
memory by specifying the kernel /C by a power law in the quantity p. Hereby we follow the 
ideas discussed recently Q • 



A. Polynomial kernel 
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Based on the analysis of under-cooled liquids in the frame of mode-coupling theory 
the random walk had been analyzed in a glass-like environment . In that case the memory 
kernel becomes 

}C{r,t) = Xp\r,t) , (11) 

where A is the strength of the memory. Because in that case K(t) is different from zero and 
in general different from —1 one has to choose the operator C = ~dtp{f,t) to preserve the 
basic quantity p. The evolution equation reads 

t 00 

dtp{f,t) = DV'^p{f,t) -xjdt'j d'^r'p^{r~r\t- t')dtir',t') . (12) 

-00 

Making a simple scaling transformation r — Ar, t — > A^t, p hr'^p, the evolution equation 
with the memory kernel, defined by Eq. remains invariant by the replacement D — >■ 
DA^~^ and A — > AA"^"^. From here one gets the critical dimension dc = 2. Defining according 
to Eq. (jni) K{t) = A J d'^rp'^{r,t), the mean square displacement s(t) obeys as follows from 
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Eq. © after Laplace transformation 

,^,^ = so[z + zk{z)]+2Dd ^.^^ s, = sit = 0) = (13) 
z[z + zK{z)] 

As demonstrated in the non-hnear transport process with the kernel JC in Eq. (jllj) allows 
a stationary solution. Following Eq. (jUI) the stationary part of the kernel reads 



oo 



k{z) = ^ with B = B{k = 0) = \ j d'^rg^if) ^0, 

— oo 

where g{r) is the stationary solution according to Eq. (jT)). As a result the mean square 
displacement exhibits a finite stationary solution 

2dD D 

hm s{t) = oc - , (14) 



which is only reasonable for a positive memory strength A > in agreement with [l^ll^l. For 
simplicity the initial value sq is assumed to be zero. In the short time regime, characterized 
hj z ^ 0, we find s{z) ~ 2dDz^'^. As a consequence the mean square displacement increases 
linearly in t, whereas s{t) becomes constant in the long-time limit. The characteristic cross- 
over time from a linear increase in time to the constant stationary value, given by Eq. ()14|) . 
is given hj tc = 1/B. A linear stability analysis shows that the finite stationary solution 
is stable. Physically a finite stationary limit can be identified with localization. Owing the 
self-organized memory effects a finite amount of particles remains localized preventirig a 
further transport. The analytical results are well confirmed by numerical simulations (1(tI |. 
Note that one can also calculate higher order moments like w{t) =< (r ^)^ > which offers 
also a stationary behavior which fulfills the relation 

lim w{t) = ( 1 + 3 ) I 2 - ^ ) lim s^{t) 




t^Qo \ d j \ Dd j t^oo 



with B2 = X j d'^rf'^g'^{f). A similar behavior can be deduced for another power law 
memory kernel. 



B. Non-linear diffusion 



Now we regard as a further realization of Eq. Q with a conserved p{f, t) a non-linear 
diffusion equation. Here the non-linearity may be originated by the memory. For example, a 
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Brownian particle moving in a strongly disordered medium, can be subjected to additional 
delay effects due to the interaction with the environment. Another application could be 
realized by transport of food in plants, where the food is temporally stored in certain cells 
and released later as required. 

In terms of our model the instantaneous term is chosen as conventional diffusion, but the 
memory kernel /C is also related to gradient terms, i.e. the /C = /iV^p. This realization is a 
generalization of Cattaneo's law jsG, 37, 3^, where the current is assumed to be j(r, t + r) oc 
Vp(r, t). Thus, the model includes not only the instantaneous and local coupling to the 
gradient but also there appears a non-local, time-delayed diffusive mechanism. The evolution 
equation reads after partial integration 

t oo 

dtp{f, t) = DV^f, t) - /i J dt' j d'^r' Wpif- r \t - t') ■ dt'Wp{r\ t') . (15) 

-oo 

The non-linear term is a competitive one to the conventional diffusion term. Both concen- 
tration fluctuations at times t and t', respectively contribute to the behavior of the system. 
Different to the diffusion constant D > 0, the sign of the parameter can be positive and 
negative indicating the "direction" of the feedback. Note that in this case the memory is 
not determined by an external function as in the previous section, but the memory is self- 
organized by the quantity p(r, t) and Vp. The non-linear term is of the same form as used 
in the so called KPZ-equation j39|. 

As discussed before, Eq. (fT^ remains invariant under a simple scaling transformation for 
the spatial and time variable as well as the probability density by replacing 

From here we conclude that the non-linear feedback term in Eq. fjlSp behaves like diffusion. 
In terms of the effective diffusion parameter D, introduced in Eq. (0), the model leads to 

D{k^z) = — . 

1 + fik'^p{k, z) 

For a positive memory parameter yU > 0, it results D < D. In the long wave length limit 
k = we find D{k = 0, z) = D, while in the long time limit corresponding to z ^ 0, the 
effective diffusion parameter is different from D. According to Eq. ((Zj) the model exhibits 
the two stationary solutions 

g+{r) = and g-{r) = po{r) - -^5{r) . 



Here we have introduced the scale-free parameter = fi/D. The non-trivial solution is 
accessible if g- > which is fulfilled for yU > 0. Because both solutions are stable within 
a linear stability analysis, compare Eq. [7j), one has to study the complete dynamics. To 
that aim let us perform a combined Fourier and Laplace transformation of Eq. (jl5j) . The 
resulting quadratic equation offers two solutions p±{k,z) with 

n=l ^ ' 

p_(k, z) = -M^ - - z) 
Ax Aiz 

^ ^ ^ ^ T(n--) 

with Ai{k) = iJ.k'^poik), ^(A;) = k'^[D- ^.po{k) ], and a„ = ' f (16) 

After a tedious but straightforward calculation we find an exact expression for p+{k, t) where 
we have used for simplicity po{k) = pq. It results 

.r N Poe"^^* >^ r(n- l/2)(-4Ait)"-i) , , ,,,2, 

^ n=l 

where M(a, 6; x) =1 Fi{a,b;x) is Kummer's confiuent hypergeometric function [4Q]. Using 
the expressions for the quantities Aa and A2, defined in Eq. flT^ . one concludes that the 
solution p^{k,t) is a function of k'^t as in case of conventional diffusion. Therefore, after 
Fourier transformation the solutions can be written as 

P+(r,t) = -^Ff^l . (18) 



where the scaling function F[w) is different from the diffusive case. To proceed further we 
use the asymptotic representation of Kummer's function leading to 



p,(*.*)-Poe-«:^l^^^^S, (19) 

— t\'AiA2 

where h{y) is the modified Bessel function j40|. In the long time limit the solution p+, 
belonging to the stationary solution = 0, is stable whereas the other solution related 
to g^ becomes unstable. Actually from Eq. (fT^ we can get the spatiotemporal solution. 
Remark that an divergent factor, proportional to k"^ in the denominator of Eq. (fTHl is com- 
pensated by the modified Bessel function Ji. This is also the reason that one can not use 
the asymptotic expansion of Ji in estimation the scaling function F{w) in Eq. (^Hj)- We find 

p. ^ poe Poll y {2n)\ d/2^iff^\ 

{4n{D-^,po)tY/'^^\d-^^poJ n\r{n + 2r'- \tj' ^^^^ 
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with the Laguerre polynomials L'^ai^)- To establish the difference to conventional diffusion 
let us study the mean square displacement s{t) =< r^>. According to Eq. (jnj s{t) obeys 
the equation 

^s{t)=2dD- [ dt'k{t-t')L2{t')- [ dt'k2{t-t')L{t'). (21) 
dt Jq Jq 

Within the model, discussed in this section, we find from Eq. (j2H) s{t) = 2dDt. The mean 

square displacement is identical with that for diffusion. It is independent on the memory 

strength /x. The difference to diffusion becomes visible in higher order moments. Using the 

same procedure as for deriving Eq. (PT|) . we obtain for w{t) =< {r^Y > the equation 

^w{t) = s{t) [AD{d + 2) + 2/i(rf + 4)] . 

Whereas the fourth order cumulant C^it) = w(t) — 3s(t) for conventional diffusion is C4(t) = 
2d{l — d){2DtY 1 it results for the model with memory 

Ci{t) = {2Dtf2d l-d+^{d + A) . 

The cumulant depends on the ratio fi/D = . The result can be extended to higher order 
cumulants. 



IV. CONCLUSIONS 

In this paper we have extended the conventional modeling of diffusive processes by in- 
cluding non-Markovian memory terms within the evolution equation. The additional terms 
are chosen in such a manner that the relevant variable p(r, t) can be normalized. By this 
requirement the form of the memory term is restricted to a class where the changing rate of 
p at the observation time t is coupled to the changing rate of p at a former time t' . Insofar 
the delay effect offers a long time memory due to < t' < t. Further the model exhibits 
also a long range memory because the kernel K, depends on r — r ' . As a new ingredient the 
memory term is determined by the basic quantity p(r, t) itself, i.e. the memory is dominated 
by the spatial-temporal scale of the probability density p. In the paper we demonstrate that 
such a self-organized feedback coupling may change the dynamical behavior of the system 
essentially, in particular due to the non-linearity of the memory effects. In case the memory 
offers a power law dependence on p with a memory strength A the particle performing a ran- 
dom walk, can be localized and therefore a further transport is prevented. This situation is 
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realized for an "attractive" memory strength A > 0, where the return probabihty dominates 
the dynamical behavior. There exists a finite stationary limit of the mean square displace- 
ment s(t) determined by the ratio of the diffusive constant versus the memory strength: 
s{t — > oo) oc D/X. The reason for such a new behavior is by means of an explicit coupling of 
the rate of the concentration at the observation time t to that one at a previous time. This 
time accumulation is further accompanied by an additional spatial accumulation, the effect 
of which is comparable to the effect a long-range interaction forces and consequently the re- 
sults are basically independent on the spatial dimensions in according to scaling arguments. 
These many-body effects are shown to change the asymptotic behavior drastically. Due to 
the feedback-coupling of a particle to its environment, a subsequent particle, undergoing a 
diffusive motion, gains information from a modified environment. Hence the particle can 
be confined within a certain region preventing a further transport. In this manner a self- 
organized memory leads to a non-zero stationary mean square displacement controlled by 
the memory strength. 

A further application is given by a non-linear diffusive process where the memory is also 
originated by gradient terms with the strength /x. Although the additional non-linear mem- 
ory term offers the same scaling behavior as conventional diffusion the resulting probabil- 
ity distribution is completely different from diffusion. Whereas the second moment, the 
mean square displacement, shows a diffusive behavior, higher order cumulants, in particular 
Binder's cumulant 

reveals deviations from conventional diffusion. Especially, Cs is determined by the strength 
of the memory. The analysis will be extended to chemical reactions in multicomponent 
systems. 
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